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Abstract. For any bounded regular domain H of a real analytic Rie- 
mannian manifold M, we denote by Xi^{Q) the fc-th eigenvalue of the 
Dirichlet Laplacian of Q. In this paper, we consider Afc and as a func- 
tional upon the set of domains of fixed volume in M. We introduce and 
investigate a natural notion of critical domain for this functional. In 
particular, we obtain necessary and sufficient conditions for a domain 
to be critical, locally minimizing or locally maximizing for X/,. These 
results rely on Hadamard type variational formulae that we establish in 
this general setting. 

As an application, we obtain a characterization of critical domains 
of the trace of the heat kernel under Dirichlet boundary conditions. 



1. Introduction 

Isoperimetric eigenvalue problems constitute one of the main topics in spec- 
tral geometry and shape optimization. Given a Riemannian manifold M, a 
natural integer k and a positive constant V, the problem is to optimize the 
fc-th eigenvalue of the Dirichlet Laplacian, considered as a functional upon 
the set of all bounded domains of volume V of M. 

The first result in this subject is the famous Faber-Krahn Theorem 
originally conjectured by Rayleigh, stating that Euclidean balls minimize the 
first eigenvalue of the Dirichlet Laplacian among all domains of given volume. 
Extensions of this classical result to higher order eigenvalues, combinations of 
eigenvalues as well as domains of other Riemannian manifolds or subjected to 
other types of constraints, have been obtained during the last decades and a 
very rich literature is devoted to this subject (see for instance [H |31 SI [3 [HI ISl 
[101 [Til [M [23 Ha EOl Ei [37] and the references therein). 

A fundamental tool in the proof of many results concerning the first Dirich- 
let eigenvalue is the following variation formula, known as Hadamard's formula 
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[iTiiigisaias]: 

where Ai(rie) stands for the first Dirichlet eigenvalue of the domain fig, ^ 
denotes the normal derivative of the first normalized eigenfunction cj) of the 
Dirichlet Laplacian on Qq and v is the normal displacement of the bound- 
ary induced by the deformation. This formula shows that a necessary and 
sufficient condition for a domain fl C M" to be critical for the Dirichlet first 
eigenvalue functional under fixed volume variations, is that its first Dirichlet 
eigenfunctions are solutions of the following overdetermined problem: 

' A0 = in n 

< = on (?r2 

for some constant c. Since a first Dirichlet eigenfunction does not change 
sign in il, it follows from the well known symmetry result of Serrin [34' that 
(j) is radial and is a round ball. Therefore, Euclidean balls are the only 
critical domains of the Dirichlet first eigenvalue functional under fixed volume 
deformations. 

Notice that Hadamard's formula remains valid for any higher order eigen- 
value Afc as far as Xk{^) is simple. Nevertheless, when Xk{^) is degenerate, 
a differentiability problem arises and our first aim in this paper (see Section 
3) is to introduce, in spite of this non-diffcrcntiability problem, a natural and 
simple notion of critical domain. 

Indeed, using perturbation theory of unbounded self-adjoint operators in 
Hilbert spaces, we will see that, for any deformation fi^, analytic in e, of a 
domain of a real analytic Riemannian manifold M, and any natural integer 
k, the function e t-^ Xk{^e) admits a left sided and a right sided derivatives 
at e = 0. Of course, when is a local extremum of Afc, these derivatives 
have opposite signs. This suggests us to define critical domains of to be 
the domains such that, for any analytic volume-preserving deformation f2e 
of O, the right sided and the left sided derivatives of Xk{i^e) at £ = have 
opposite signs. That is, 

±Xkin,)l^,,x ±Xk{n,)l^^_<o. 

which means that Xk{^e) < Xk{^)+o{e) ot Xk{^e) > Xk{^e) + o{e) as e ^ 0. 

After giving, in Section 2, a general Hadamard type variation formula, we 
derive, in Section 3, necessary and sufficient conditions for a domain ^l of 
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the Riemannian manifold M to be critical for the fc-th Dirichlet eigenvalue 
functional under volume-preserving domain deformations. 

For instance, we show that (Theorem 13. 3p if is a critical domain of 
the fc-th Dirichlet eigenvalue under volume-preserving domain deformations, 
then there exists a family of eigenfunctions , . . . , 0™ satisfying the following 
system: 



(1) 



A0i = Afc(il) (pi in il, Vi < m, 
4>i = on 9f2, Vi < m. 



Moreover, this necessary condition is also sufficient when either Afe(O) > 
Afc_i(ri) or \k{^) < \k+i{^), which means that Afc(n) corresponds to the 
first one or the last one in a cluster of equal eigenvalues. On the other hand, 
we prove that if Afc(r2) > Xk-i{^) (resp. Xk{^) < Xk+i{^)) and if 17 C M is a 
local minimizer (resp. maximizer) of the fc-th Dirichlet eigenvalue functional 
under volume-preserving domain deformations, then Afe(f2) is simple and the 
absolute value of the normal derivative of its corresponding eigenfunction is 
constant along the boundary 917 (see Theorem 13. ip . 

The last section deals with the trace of the heat kernel under Dirichlet 
boundary conditions defined for a domain 12 C M by 



^ fc>i 

where H is the fundamental solution of the heat equation in 12 under Dirichlet 
boundary conditions. Indeed, Luttinger [23] proved an isoperimetric Faber- 
Krahn like result for Y{t) considered as a functional upon the set of bounded 
Euclidean domains, that is, for any bounded domain 12 C M" and any t > 0, 
one has lo(t) < Yji* (t), where 17* is an Euclidean ball whose volume is equal 
to that of 12. 

For any smooth deformation 12^ of 12, the corresponding heat trace function 
Y^{t) is always differentiable w.r.t. e and the domain 12 will be said critical for 
the trace of the heat kernel under the Dirichlet boundary condition at time t 
if, for any volume-preserving deformation r2e of 12, we have 

After giving the first variation formula for this functional (Theorem 14. we 
show that a necessary and sufficient condition for a domain 12 to be critical 
for the trace of the heat kernel under Dirichlet boundary condition at time t 
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is that the Laplacian of the function x i— > x, x) must be constant along 
the boundary dVl (Corollary 14. ip . 

Using Minakshisundaram-Pleijel asymptotic expansion of Y[t)^ one can 
derive necessary conditions for a domain to be critical for the trace of the heat 
kernel under Dirichlet boundary condition at any time i > 0. For instance, 
we show that the boundary of such a domain necessarily has constant mean 
curvature (Theorem 14. 2p . 

Thanks to Alexandrov type results (see [Tl[23]), one deduces that when the 
ambient space M is Euclidean, Hyperbolic or a standard hemisphere, then 
geodesic balls are the only critical domains of the trace of the heat kernel 
under Dirichlet boundary condition at any time i > (Corollarv l4.3p . 

2. Hadamard type variation formulae 

Let ri be a regular bounded domain of a Riemannian oriented manifold 
{M,g). We will denote by g the metric induced by g on the boundary dCl of 
fl. Let us start with the following general formula. 

Proposition 2.1. Let (y^) be a differ entiahle variation of the metric g. Let 
4>e C C°°(ri) be a differentiable family of functions and Ag a differ entiable 
family of real numbers such that, Ve, H^eHl^^q = 1 and 

Aa,d>e = A^d)^ in O 



— on dfl. 



Then, 



n 



bo + ^A0o g,h)vg, 



where h := ^5e|^_Q) A' := ^Ag^ l^-o ^^'^ ^' ^ inner product induced by 

g on the space of covariant tensors. 

Proof. For simplicity, let us introduce the following notations: A := Ao, := 

Differentiating the two sides of the equality Ag^^j = A^^^ we obtain 
A'0 + A0' = A> + A0'. 
After multiplication by cf) and integration we get 

(t)A'(t)Vg + / (j}A(j)'vg = A' + A / (t)(j)'v 

Integration by parts gives 



a ' •^L^lfJ Ug — IV n I KyifJ Ug. 

n Jn Jn 



Jn Jdn 
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Thus, 



Jn Jon di^ dv 



It is clear that the boundary integral in this last equation vanishes (since 
0e = on dVL). 
In conclusion, wc have 



(2) A'= / (j}A'(j)v 



Now, the expression of A' is given by (see j4]) 

(3) A'0= (L'^^,/!) -(d<?i,(5/i + ^d/i), 

where h is the trace of h w.r.t. g (that is h — {g,h)). Integration by parts 
yields 

(4) / cp{dcp,5h)vg ^ \ [ {D^Cj,',h)Vg 

Jn ^ Jn 



i(f>(g)d(j) + 4>D'^4>, h)vg 
n 



and 



(5) / <f>{d(t>,dh)Vg - - / hA<f>'Vg 

Jn ^ Jn 

Combining 0, ([3]), (g]) and ^ we obtain 

A' = - I {d4i(g)d(p+ -Acjy^g, h)vg 
Jn 4 

which completes the proof of the proposition. □ 

In the particular case of domain deformations. Proposition 1 2 . 1 1 gives rise to 
the following variation formulae. 

Corollary 2.1. Let Q,^ — fe{^) be a deformation ofH,. Let (j>^ G C°°{n^) and 
Ae G R &e two differentiable curves such that, Ve, ||?!'e||L2(OB,g) = 1 o.'f^d 

A(f)^ ^ Aj0£ in Slj 

(j)f^ — on dQf^. 
Then, 
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where (j) ~ andv = g (^/e|g_o' ^) normal component of the variation 

vector field of the deformation fi^ . 



Proof. Let us apply Proposition 12.11 with ~ f*g and cfy^ = (f>e o fe- Indeed, 
one can easily check that H^ellis^fi — 1, Ag^0£ = ^e4'e in ^ and 0^ = on 
dVl. Hence, 

(6) _ A4^p = - {d(f> ®d(t)+ - A,/)2 .g, h)Vg 

with (p := (po = (j>Q and ft, = ^/*5|e-o ~ ^vg, where Cyg is the Lie derivative 
oi g w.r.t. the vector field V = ^/e|j_o' 

Using the expression of Cyg in terms of the covariant derivative W olV 
and integrating by parts, we obtain 

/ {d(P(E)d<P,Cvg)vg^ / /:y(7(V0, V(/))vg = 2 / (Vv0"t^,V0)wg 
Jn Jn 

= [ div((-l/,V0)V0K+2 / {V,V<j))A^Vg~2 [ D''4>{V,V4>)vg 
Jn Jn Jn 

= 2 / (F,V0)^ v-g + X f {V,V(t>^)vg^2 f D^<P(V,V<P)vg, 
Jdn ov 

with A := Ao, and 

i f Acl)^{g,Cvg}vg ^ \ l A4,''diYVvg 



A / rdiv^wg - / iV^^div^Wg 
Jn Jn 



(A0^-|V</>n(F,i^)«g. 
ao 



Replacing in ([5]), we get 

-^A4^o= / {-2(F,V0)^ + (l/,^.)|V0|2-A(l/,^.)0n^^§- 

Since <f> is identically zero on the boundary, we have at any point of 

= ^v. In particular, |V</>|2 = (M)' and (F,V(/.) = = 7;f^. 

Thus, 

2 



□ 
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3. Critical domains 

Throughout this section, the ambient Riemannian manifold (M, g) is as- 
sumed to be real analytic. 

3.1. Preliminary results and definitions. Let f2 be a regular bounded 
domain of a Riemannian manifold (M,g). An analytic deformation (Oe) of f2 
is given by an analytic 1-parameter family of diffeomorphisms : fl fig 
such that /e(9ri) — d^l^ and /o = Id. Such a deformation is called volume- 
preserving if the Riemannian volume of w.r.t the metric g does not depend 
on e. 

The spectrum of the Laplace operator Ag under the Dirichlet boundary 
condition will be denoted 

Sp„ (Ag, rJe) = { Ai^e < A2,e < • • • < Xk^e T + OO } 

The functions e i— > Xk^e is continuous but not differentiablc in general, ex- 
cepting Ai^e which is always differentiable since it is simple. However, as we 
will see hereafter, the general perturbation theory of unbounded self-adjoint 
operators enables us to show that the function Xk^e admits a right sided and 
a left sided derivatives at e = 0. In all the sequel, a family of functions 
4>e G C°°{^le) will be said differentiable (resp. analytic) w.r.t e, if that is the 
case for (f>e o e C°°{n). 

Lemma 3.1. Let X € Spi^{Ag,Q) be an eigenvalue of multiplicity p of the 
Dirichlet Laplacian in fl. For any analytic deformation fi^ of fl, there exist 
p families {Ai^^)i<p of real numbers and p families {4'i,e)i<p C C°°{Qs) of 
functions, depending analytically on e and satisfying, Ve G (— eo,eo) o^nd Vi G 

(a) Ai^o = X 

(b) the family {01. e, ■ • • ,4'p.e} is orthonormal in L^{fl^,g) 




A = Ai^e<l>i,e in f^e 

4>i^e = on dQs 



The proof is based on perturbation theory of unbounded self-adjoint oper- 
ators in Hilbert spaces. Results concerning the differentiability of eigenvalues 
and eigenvectors have been first obtained by Rellich [ST and then by Kato 
[T9j in the analytic case. Many results were also obtained under weaker differ- 
entiability conditions (see for instance [12 [H] for recent contributions in this 
subject). Nevertheless, even a smooth curve e i-^ of self-adjoint operators 
may lead to noncontinuous eigenvectors w.r.t. e (see Rellich's example |19i 
chap II, Example 5.3]). Since we need to differentiate eigenvectors w.r.t. e, we 
imposed analyticity assumptions in order to get analytic curves of operators. 

Proof of Lemma \3.1l In order to get into the framework of perturbation the- 
ory, we first need to modify our operators so that they all have the same 
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domain. Indeed, for any e we set — f*g and denote the Laplace opera- 
tor of (rij^e). Clearly, we have 

Notice that since depends analytically on e and that g is real analytic, the 
curves e t—^ g^ and, hence, e t—f are analytic w.r.t. e. 

The operator A^ is symmetric w.r.t. the inner product in Lp'{VL,g^), but 
not necessarily w.r.t. the inner product in L^{n,g). Therefore, we need to 
introduce a conjugation as follows. Let : L?{Vl,g) L'^{Q,gs) be the 
unitary isomorphism given by 



\9\_ 

where \g\ = det{gij) is the determinant of the matrix (gij) of the components 
of g in a local coordinate system. We define the operator to be 

Pe = U-^ o Ae o Ue. 

Therefore, we have Sp^{Pe,il) — S'p„(Ae, fi) and, if e C°°{n) is an eigen- 
function of P^, then 0^ = f/e(we) o /r^ G C°°{fle) is an eigenfunction of A^ 
with the same eigenvalue. Again, since Ve, (M, g^) is real analytic, the curves 
£ i~> J7e and e t-^ P^ are analytic. The result of the lemma then follows from 
the Rellich-Kato theory applied to e i-^ Pg. 

□ 



Now, let us fix a positive integer k and let Ai.g, . . . , Ap.^ be the family of 
eigenvalues associated with Afc by Lemma 13.11 Using the continuity of Xk,e 
and the analyticity of A^^g w.r.t. e, we can easily see that there exist two 
integers i < p and j < p such that 

Ai.e if e < 



Afc,e — 



Aj, e if £ > 0. 



Hence, Xk,e admits a left sided and a right sided derivatives with 
and 

d_ I _d_ I 

de "'"1^=0- " de^''l-=o- 
Definition 3.1. The domain is said to be "critical" for the k-th eigenvalue 
of Dirichlet problem if for any analytic volume-preserving deformation 51^ of 
fl, the right sided and the left sided derivatives of X^.e at e — have opposite 
signs. That is, 

d ^ I d ^ I 
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It is easy to see that 
and ^ 

^Afc.4=o- ^ < ^Afc,4^„+ 4=> Afc,e > Afc,o + o(£). 

Therefore, the domain fi is critical for the fc-th eigenvalue of Dirichlet problem 
if and only if one of the following inequalities holds: 

Afe,e < Xk^o + o{e) 

Afe,£ > Afc,o + o(e). 



Remark 3.1. Suppose that for an integer k we have Xk < Afe+i, then, for 
sufficiently small e, we will have Xk.e — max A^.e, where Ai^^, ■ • • , ^p.e are the 

eigenvalues associated to Xk by Lemma \3.1\ (indeed, A^^q = Afe < Afe+i for any 
1 < i < p). Hence, ^ Xk,E\e=o- 1^ '^Xk,e\e=o+ ■ particular, Q is critical 
for the functional ft i-^ Afe(il) if and only if -^Xk,e\s=o- !i < ^Afe^e|e=o+ 
(or, equivalently, Xk,e < Afe^o + o{e)). 

Similarly, if Xk~i < Xk, then, for sufficiently small e, Xk,e — niinA^^^ and 

i<p 



Lemma 3.2. Let X G Sp^{lS.g,^) he an eigenvalue of multiplicity p of the 
Dirichlet Laplacian in U, and let us denote by E\ the corresponding eigenspace. 
Letfl^ ~ fe{^) be an analytic deformation offl and let (Ai_e)i<p and {4>i,e)i<p C 
C°°(r2e) be as in Lemma[3li Then A[ J^Ai,^ j^^^, • ' • := i7Ve|e=o 
are the eigenvalues of the quadratic form defined on the space Ex C L^{^, g) 
by ^ 

where v = g (^/e|j_Q7 '^)- Moreover, the L? -orthonormal basis <j)i.o, ' ' ' j 4'p,o 
diagonalizes q^ on E\. 

Proof. For simphcity, we set g^ /*.g, A' := ^AgJ^^^, A,; := A^^o, := 0i,o 
and A^ := ii^i,e\^^Q- From lS.g^{(j)i^^) = Ai,e(0i,e), we deduce 

AV, + A0^ = A>, + A,(/)^ 
We multiply by (fij and integrate to get 

/ 4>jlS.'4>iVg + I 4>jA(j)[Vg ^ K[ I 4>^4>jVg + X / 4>i4>'jVg. 

Jn Jn Ja Jn 
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Integration by parts gives ( since (j>j = tp- — on dil)) 



Jn Jn 



n 



(j)jA'(t)iVg = A- / (j)i(j)jV. 



Hence, 



Therefore 

Jn Jn 
It follows that the L^-orthonormal basis 0i , ■ • • ,4>p diagonalizes the quadratic 
form 4> ^ Jii 't'A'(j)Vg on E\, the corresponding eigenvalues being K'l, - ■ ■ , A^. 
As we have seen in the proof of the corollary 12.11 this last quadratic form 
coincides with on E\. □ 

Any volume-preserving deformation = /e(f^) induces a function v := 
S'(^/e|e-o' ^) satisfying J^^ vvg — (indeed, this last integral is equal 

up to a constant to -^voI{Qe)\^_^). In all the sequel, we will denote by Aoidfl) 
the set of regular functions on dil such that Jg^Wg — 0. The following 
elementary lemma will be useful in the proof of our main results. 

Lemma 3.3. Letv G Ao{dfl). Then there exists an analytic volume-preserving 
deformation fl^ = so that v — ^(^/elg—gi 

Proof. Let f/ C M be an open neighborhood of and let v and i/ be smooth 
extensions to U of v and v respectively. For e sufficiently small, the map 
iPeix) = exp^ e v{x) v{x) is a diffeomorphism from to ^e{^)- Moreover, since 
(M, g) is real analytic, the curve e — *■ is analytic w.r.t. e. The deformation 
^Pe{^) is not necessarily volume-preserving. However, let X be any analytic 
vectorfield on U such that /^^ AbfXvg ^ and denote by ["ft)t the associated 
1-parameter local group of diffeomorphisms. The function (t, e) i— s- Fit, e) = 
vol{-^t ° 'fei^)) satisfies ^F(0,0) — J^divXvg ^ 0. Applying the implicit 
function theorem in the analytic setting, we get the existence of a function 
t(e) depending analytically on e e (— 77,7^), for some 77 > sufficiently small, 
such that F{t{e),e) = F(0,0), Ve € {—ri,r]). The deformation — "ft(e) ° '■Pe 
is clearly analytic and volume-preserving. Moreover, one has 

Therefore, Vx G dVl, 

□ 
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3.2. Critical domains for the fc-th eigenvalue of the Dirichlet Lapla- 
cian. In all the sequel, we will denote by Afc the fc-th eigenvalue of the Dirich- 
let problem in Q and by Ek the corresponding eigenspace. 

In the following results, a special role is played by the eigenvalues Afc sat- 
isfying Afc > Afc_i or Afc < Afc+i. This means that the index k is the lowest 
or the highest one among all the indices corresponding to the same eigen- 
value. Let us start with the following necessary condition to be satisfied by 
a locally minimizing or locally maximizing domain. Here, a local minimizer 
(resp. maximizer) for the fc-th eigenvalue of the Dirichlet Laplacian is a do- 
main Q such that, for any volume-preserving deformation fJ^, the function 
£ I— > Afc_e admits a local minimum (resp. maximum) at £ = 0. 

Theorem 3.1. Let k be a natural integer such that Afc > Afc_i (resp. Afc < 
Afc+i^ and assume that D, is a local minimizer (resp. local maximizer) for the 
k-th eigenvalue of the Dirichlet Laplacian. Then Afc is simple and the absolute 
value of the normal derivative of its corresponding eigenfunction is constant 
on Oil. That is, there exists a unique (up to sign) function (f> satisfying 

Acf) ~ Afc(/) in n 
< = on dil 
. = 1 ondn. 

Proof. Suppose that Afc > Afc_i and let fig = fd^) be a volume preserving 
analytic deformation of fl. Let (Aj^e)i<p and {(f>i^e)i<p be families of eigen- 
values and eigenfunctions associated to Afc according to Lemma 13.11 Since 
■^^1,0 = Afc > Afc_i, we have, for sufficiently small e, for continuity reasons. 

Hence, 

Ai^e > Afc^e. 

As the function s t-^ Xk.e admits a local minimum at e = with A^.o = 
-^/c.o = Afc, it follows that the differentiable function e i— > A^^^ achieves a local 
minimum at e = and that ^Ai^gj^ ^ = 0. Applying Lemma [5?^ we deduce 
that the quadratic form qy is identically zero on the eigenspace Ek, where 
V = sC^/elg—Qi The volume-preserving deformation being arbitrary, it 
follows that the form q^ vanishes on Ek for any v G Ao{dn) (Lemma 13. 3[) . 

Therefore, Vi/) G Ek and Vu G Ao{dfl), we have Jg^v (f^) Vg — 0, which 

implies that ^ is locally constant on dfl for any G £'fc. Now, if and 4>2 
are two eigenfunctions in Ek , one can find a linear combination (j) = a0i -I- /302 
so that 1^ vanishes on at least one connected component of dfl. We apply 
Holmgren uniqueness theorem (see for instance (27t Theorem 2, p. 42], and 
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recall that (Af , g) is assumed to be real analytic) to deduce that (f> is identically 
zero in f2 and that Afc is simple. 

To finish the proof, we must show that, S Ej., \^\ takes the same 
constant value on all the components of dfl. Indeed, let Si and S2 be two 
distinct connected components of dft and let v G AQ{dn) be the function 
given by w = vol{'S2) on Ei, v — —vol(Y,i) on S2 and w = on the other 

components. Then the condition J^^ v ^f^^ ^ ^ implies that 

(d±Y\ 

Of course, the same arguments work in the case Afc < Afe+i. □ 

The criticality of the domain fl for the fc-th eigenvalue of Dirichlct Laplacian 
is closely related to the definitcness of the quadratic forms qy introduced in 
Lemma [321 above, on the eigenspace Ek- Indeed, we have the following 

Theorem 3.2. Let k he any natural integer. 

(1) If n is a critical domain for the k-th eigenvalue of the Dirichlet Lapla- 

, V 2 

dan, then, \/v S Ao{dfl), the quadratic form qv{(j)) = — /g^j ( ) "f^g 
is not definite on E^. 

(2) Assume that A^ > Afe_i or Afc < A^+i and that Vu e Ao{dfl), the 

quadratic form qv{4>) — — /g^ ''^ Vg is not definite on Ek, then Q, 

is a critical domain for the k-th eigenvalue of the Dirichlet Laplacian. 

Proof. (1) Consider a function v E Ao{dfl) and let fig — fe{^) be an analytic 
volume-preserving deformation of Q so that v := i^) (Lemma 13. 3[) . 

Let (Ai_£)i<p and {4>i,e)i<p be families of eigenvalues and eigenfunctions asso- 
ciated to Afc according to Lemma l3. II As we have seen above, there exists two 
integers i < p and j < p so that -^^k,e\^^Q- = ii^iAe=Q ^^'^ ii'^i^Ae=o+ = 
^Aj_e|^_p. The criticality of then impHes that x ^e^i-Ae-o — ^' 

Applying Lemma 13.21 we deduce that the quadratic form q^ admits both 
nonnegative and nonpositive eigenvalues on Ek which proves Assertion 1. 

(2) Assume that Xk > Afe_i and let fig = /e(f2) be a volume-preserving 
deformation of f2. Let (Ai^e)i<p and {4'i,e)i<p be families of eigenvalues and 
eigenfunctions associated to Afc according to Lemma 13.11 As we have seen in 
Remark 13. 11 we have, for sufficiently small e, Afc^^ — minAi^e. Hence, 

|Afc,|^^„,=min^A,4^„ 

and 

^ X I ^ A I 

-Afc.,4^„_=inax-A,,L^^„. 

Now, the non definitcness of q^ on Ek means that its smallest eigenvalue 
is nonpositive and its largest one is nonnegative. According to Lemma [ 
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this implies that ^A/c,e|^^g+ mini<p ^Ai^ej^^^^ < and ^ Afc^^l^^o- = 
niaxi<p ^Ai^^l^ g > which imphes the criticahty of the domain fl. 

The case < Afe+i can be handled similarly. □ 

The indefiniteness of for any v e Ao{dfl) can be interpreted intrinsically 
in the following manner: 

Lemma 3.4. Let k be a natural integer. The two following conditions are 
equivalent: 

(i) Vf G AQ{dfl), the quadratic form q^ is not definite on Ek 

(ii) there exists a finite family of eigenf unctions {(f>i)i<m C Ek satisfying 

Proof. To see that (ii) implies (z), it suffices to notice that, for any v G Ao(d^) 

Therefore, q^, is not definite on E^. 

The proof of "(z) implies (zi)" uses arguments similar to those used in the 
case of closed manifolds by Nadirashvili and the authors [H] . Let K be 

the convex hull of | ^ ,(j)<^E,}^ in C°°{dn). Then, we need to show that 

the constant function 1 belongs to K. 

Let us suppose for a contradiction that 1 ^ then, from the Hahn- 
Banach theorem (applied in the finite dimensional vector space spanned by K 
and 1 and endowed with the L^{dfl, g) inner product), there exists a function 
V e C°°{d^) such that v Vg > and, \f(l) e Ek, 

Ian 

Hence, the zero mean value function Vo — v ~ ^^i^g^^) Ian ^9 satisfies, V0 G 
Ek, 

Qvo (0) = - / Voi^ 

Jan V 

V[ -:-] Wg H TTT^TTT I V Vo i ^ ] Va 



an \diyj vol{dn) Jg^ Jan\diy 
1 f f fdcj)^ ^ 



vol{dVL) Jq^ ^ Jon\dv 



IT. 



> 

with Jgj^ (f^) ^9 ^ ^ '^'^'^ trivial Dirichlet eigenfunction (p (due to 

Holmgren uniqueness theorem). In conclusion, the function Vo G Ao{d^l) is 
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such that the quadratic form qy^ is positive definite on Ek, which contradicts 
Condition (i). □ 

A consequence of this lemma and Theorem 13.21 is the fohowing: 

Theorem 3.3. Let k be any natural integer. 

(1) If fl is a critical domain for the k-th eigenvalue of Dirichlet Lapla- 
cian, then there exists a finite family of eigenf unctions {4>i)i<m C 

satisfying X]"=i (^r) = 1 on dVt, that is, {4>i)i<m are solutions of 
the following system 

A0i = XkCpi in ri, Vi < m, 
^ — on dfl, Vi < m, 

^ ET=i{^y-^ondn. 

(2) Assume that Afe > A^^-i or Xk < Xk+i and that there exists a finite 

family of eigenfunctions {4>i)i<m C E^ such that X]"=i (^if) ^on- 
stant on dfl, then the domain 17 is critical for the k-th eigenvalue of 
the Dirichlet Laplacian. 

Corollary 3.1. Assume that Xk is simple. The domain D, is critical for 
the k-th eigenvalue of the Dirichlet Laplacian if and only if the following 
overdetermined Pompeiu type system admits a solution 

A(f> = Xkcj) in Q. 
< (J) = on 
. 11^1 = 1 ondn. 

3.3. Nonexistence of critical domains under metric variations. In this 
paragraph, we point out the non consistency of the notion of critical domains 
w.r.t. metric variations under Dirichlet boundary condition. Indeed, if g^ is an 
analytic variation of the metric g, then we can associate to each eigenvalue Xk 
of the Dirichlet problem in n, analytic families (Ai^e)i<p C K and {4>i^e)i<p C 
C°°(ri) (where p is the multiplicity of Afc) satisfying, for sufficiently small e, 

(1) {4>i.e)i<p is L'^{n,gf;) orthonormal. 

(2) Vie{l,...,p}, A.,o = Afe. 

4>i^e = on 917 
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Therefore Xk,e admits a left sided and a right sided derivatives at e = 0, and 
we can mimic Definition 13.11 to introduce the notion of critical domain for 
the fc-th eigenvalue of Dirichlet problem w.r.t. volume-preserving variations 
of the metric. Thanks to Proposition 12.11 and using arguments similar to 
those used above (see also [HI HI]), we can show that, if the domain {^,g) is 
critical for the fc-th eigenvalue of Dirichlet problem, then there exists a family 
of eigenfunctions 0i , . . . , ipm € Ek satisfying 

m 

(7) ^ d4>i (g) = g. 

1=1 

Now, if we consider only volume-preserving conformal variations of g 
(that is g^ — Ue g with J^aivg = Vol{fl, g)), then the necessary condition 

rn 

^ for (ri,5) to be critical w.r.t such variations becomes 0i = 1 mil. As 

i=l 

the eigenfunctions of the Dirichlet Laplacian vanish on the boundary dil, this 
last condition can never be fulfilled by functions of Ej^. Thus, we have the 
following: 

Proposition 3.1. There is no critical domain {^,g) for the k-th eigenvalue 
of the Dirichlet Laplacian under conformal volume-preserving variations of 
the metric g. 

4. Applications to the trace of the heat kernel 

This section deals with critical domains of the trace of the heat kernel under 
Dirichlet boundary condition. 

Recall that the heat kernel H of (fi, g) under the Dirichlet boundary con- 
dition is defined to be the solution of the following parabolic problem: 

' {§-^-Ay)H{t,x,y)^0 
< H{0,x,y) = S, 
^ Vy e on, H{t,x,y) = 

Its trace is the function 

Y{t)^ [ H{t,x,x)vg 
Jn 

The relationship between this kernel and the spectrum of the Dirichlet Lapla- 
cian is given by 

ff(t,x,j/) =^e-^'=Vfc(a;)</'fc(y) 
fc>i 

where (4>)k>i is an i^(f2, g)-orthonormal family of eigenfunctions satisfying 
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(pk — on dil. 



and then, 



(8) r(t)^^e-^'=*. 

k>l 

Let rig be a smooth deformation of and let = X]a;>i e"'*''''^' be the 
corresponding heat trace function. Unhke the eigenvalues, the function Yi,{t) 
is always differentiable in e and the domain will be said critical for the trace 
of the heat kernel under the Dirichlet boundary condition at time t if for any 
volume-preserving deformation fl^ offl, we have 

From the results of section 3 above, one can deduce the variation formula for 
the heat trace. For this, we need to introduce the mixed second derivative 
dsH{t)\x of H at the point x defined as the smooth 2-tensor given by 

dsHitMX,X) - ^i/(t,c(a),c(/3))|^^^^„, 

where c is a curve in such that c(0) = x and c(0) = X. It is easy to check 
that 

dsH{t) = e-^''*d(pk <E) d(j)k 

k>l 

Theorem 4.1. Let il^ = /^(rJ) be a volume-preserving deformation ofil. We 
have, \/t > 0, 

X^eWL_o = -*/ ^dsH{t){v,j^)vg^\- j vAH{t,x,x)vg 
as Jan ^ Jan 

where v ^ ff( j^/el^^Q, t^)- 

Proof. The proof can be derived from the first variation formula of the heat 
kernel that can be found in the paper of Ray and Singer [551 Proposition 6.1]. 
Nevertheless, at least in the case where the ambient manifold is real analytic, 
the formula of Theorem 14.11 can be obtained as an immediate consequence 
of Hadamard's type formula of Section 2, thanks to the relation ([5]) above. 
Indeed, in this manner we obtain, > 0, 



Vn 
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where {Xk,(t)k) are as above. To get the desired formula for Ye{t) it suffices to 
notice that 



k>l k>l 



V 



□ 



An immediate consequence is the foUowing 

Corollary 4.1. The foUowing conditions are equivalent: 

(i) The domain fl is critical for the trace of the Dirichlet heat kernel at 
the time t under volume-preserving domain deformations, 

(ii) AH(t, X, x) is constant on the boundary dVl, 

(iii) for any positive integer k and any g)-orthonormal basis ipi, ■ ■ ■ (/)p 
of the eigenspace Ek of Xk, X]i<p (^r) ^•^ constant on dQ. 

Recall that if p is an isometry of {i^,g), then, \/x G il and Vi > 0, 
H{t, p{x),p{x)) = H{t, X, x). In particular, if f2 is a ball of M" endowed with 
a rotationally symmetric Riemannian metric g given in polar coordinates by 
g = a^{r)dr'^ + b^{r)da^, where da^ is the standard metric of the unit sphere 
then H{t,x,x) should be radial (that is depend only on the parameter 
r). Therefore, the function AH{t,x,x) is also radial and then it is constant 
on the boundary of the ball. 

Corollary 4.2. Let g be a a rotationally symmetric Riemannian metric on 
R" . The geodesic balls centered at the origin are critical domains for the trace 
of the Dirichlet heat kernel under volume-preserving domain deformations. 

In particular, geodesic balls of Riemannian space forms are critical for the 
trace of the Dirichlet heat kernel under volume-preserving domain deforma- 
tions. 

The Minakshisundaram-Pleijel asymptotic expansion of the trace of the 
heat kernel can also informs us about the geometric properties of extremal or 
critical domains. Indeed, it is well known that there exists a sequence (ai)igN 
of real numbers such that for sufficiently small t > 0, we have: 

Y{t) = (47ri)^^afct* 
&>o 

with (see for instance [HIT]): 

ao = vol{n,g), 
ai ^ -^vol{dil,g), 



a2 — - ■{ I scalgVg + 2 1 trAvg f , 
In J an 



6 
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«3 = ^ {-l&scalg - TitrAf + 10\Af + ^pg{v, v)) Vg^ , 

where scalg and pg are respectively the scalar and the Ricci curvatures of 
(fi, g), A is the shape operator of the boundary dfl (i.e VX g Tdfl, A{X) = 
Dxv) and trA is the trace of A (i.e (n — l)-times the mean curvature of dVl). 

An immediate consequence of these formulae is the following: Suppose that 
for any domain Vt' having the same volume as fi, we have Isi'(^) < ^a(i),Vi > 
0, then voldil' > voldil. Consequently, we have 

Proposition 4.1. // the domain Q maximizes Y at any time t > among 
all the domains of the same volume, then is a solution of the isoperimetric 
problem in [M, g), that is, VfJ' C M such that volQ = volQ' , we have voldQ' > 
voldfl. 

Another consequence of the Minakshisundaram-Pleijel asymptotic expan- 
sion is the following 

Theorem 4.2. If the domain Q is a critical domain of the trace of the Dirich- 
let heat kernel at any time t > 0, then dQ has constant mean curvature. If 
in addition the Ricci curvature (resp. the sectional curvature) of the ambient 
space {M,g) is constant in a neighborhood offl, then tr{A'^) (resp. tr{A^)) is 
constant on dfl. 

Proof. Let fl^ = fe{^) be a volume-preserving variation of Q and let us de- 
note for any e by (ai,e)i>o the coefficients of the asymptotic expansions of 

Ys{t). Since ^^(Ol^-o ~ ^' have for any z > 0, ^ai,e|^_o ~ ^ ^^^^ 
instance [16] for an analytic justification for this last assertion). In particular, 
j^vol{dV,^)\^_^ — for any volume-preserving variation of Q. This property is 
known to be equivalent to the fact that the mean curvature of dQ is constant 
(see for instance [29]). 

Now, let us suppose that the Ricci curvature of {M,g) is constant in a 
neighborhood of f2, then for any small e, we have: 

^2,E = \ scalgVol{Q^) + 2 / (trA^) Vg 



6 



6 

Hence, we have (see for instance [29] 

d_ 

de 



— I scalgVol{Q) + 2 / (trA^) Vg. 



itrA,)v-g\^^^^ / {A-gV- p{iy,i^)v~itrA^)v)vg 



+ \ I trA {diVgV'^ + v trA) Vg, 
2 .Idn 
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where V — ^ |g_Q — v u + V'^ on the boundary dfl. 

Since Jq^ vVg = and trA and i/) are constant on dfl, we have: 

It follows that trA'^ is constant on dil. 
As before, we have 



but, 



/ {trA,fvg\^^^^2 trA{/\-gV^ p[u,v)v^ {trA^)v)v-g 
Jan, " Jdn 

{trAf {diVgV^ + v trA) v-g 



lan^ Jdn 
1 

+ 2 
= 

since trA, trA^ and p{v, v) are constants. Thus, 

After some straightforward but long computations we obtain, using the fact 
that the sectional curvature is constant in a neighborhood of f2, and that trA 
and trA^ arc constant, 



d 



where c is a constant. This proves that trA^ is constant. □ 

Alexandrov's Theorem shows that in the Euclidean space, the geodesic 
spheres are the only embedded compact hypersurfaces of constant mean cur- 
vature. This theorem was extended to hypersurfaces of the hyperbolic space 
and the standard hemisphere (see [24]). Since the boundary of a critical do- 
main of the trace of the heat kernel is an embedded hypersurface of constant 
mean curvature, we have the 

Corollary 4.3. Let {M,g) be one of the following spaces: 

• The Euclidean space. 

• The Hyperbolic space. 

• The standard Hemisphere. 

Then a domain of {M, g) is critical for the trace of the Dirichlet heat kernel 
if and only if fl is a geodesic ball. 



trA^vVa = 0, 
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